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EXECUTIVE  SUMMARY 


The  Per-Episode  Home  Health  Prospective  Payment  Demonstration,  launched  in  1 995  by  the 
Health  Care  Financing  Administration  (HCFA),  tested  an  alternative  method  of  paying  home  health 
agencies  for  their  services  to  Medicare  beneficiaries.  More  specifically,  this  voluntary,  five-state 
demonstration  was  designed  to  examine  whether  changing  from  a  retrospective,  fee-for-service 
payment  system  to  a  prospective,  per-episode  system  would  induce  agencies  to  provide  home  health 
care  more  efficiently.  Prospective  payment  gives  agencies  an  incentive  to  deliver  cost-effective  care 
by  allowing  them  to  retain  as  profits  any  payments  that  exceed  costs. 

This  report  compares  characteristics  of  the  home  health  agencies  that  chose  to  participate  in  the 
Per-Episode  Home  Health  Prospective  Payment  Demonstration  with  characteristics  of  agencies  in 
two  other  groups:  (1)  agencies  in  the  five  demonstration  states  that  were  invited  but  declined  to 
participate  in  the  demonstration;  and  (2)  those  nonparticipants,  plus  all  others  in  the  nation  that 
would  have  been  eligible  to  participate  were  they  located  in  a  demonstration  state. 

The  purpose  of  this  comparison  is  to  determine  whether  the  demonstration  participants  were 
representative  of  other  eligible  agencies  in  their  states  and  in  the  nation  at  the  time  they  decided  to 
enroll  in  the  demonstration.  The  more  representative  the  demonstration  agencies,  the  more 
confidently  we  can  generalize  the  findings  firom  the  demonstration  evaluation.  Within  the  five 
demonstration  states,  we  found  that  participants  were  sufficiently  representative  of  nonparticipants 
to  suggest  there  is  no  pressing  need  to  revise  our  interpretations  of  demonstration  impacts.  The 
national  comparison  revealed  a  number  of  differences  between  participants  and  nonparticipants; 
however,  many  of  the  differences  were  too  small  to  cause  concern  over  generalizability.  Moreover, 
some  of  the  larger  differences  that  existed  before  the  demonstration  may  have  diminished  while 
HCFA's  Interim  Payment  System  was  in  effect  (during  which  time  a  considerable  percentage  of 
home  health  agencies  withdrew  fi-om  Medicare). 

A.   RESEARCH  HYPOTHESES  AND  ANALYTIC  APPROACH 

Because  enrollment  into  the  Home  Health  Prospective  Payment  Demonstration  was  voluntary, 
we  hypothesized  that  each  invited  agency  would  have  based  its  enrollment  decision  on  its  perception 
of  its  potential  to  earn  profits  under  prospective  payment.  Because  an  agency's  profitability  is  related 
to  the  characteristics  of  its  structure,  services,  finances,  and  external  environment,  we  hypothesized 
that  agencies  that  chose  to  participate  were  different  from  those  that  declined  with  regard  to  those 
characteristics  in  the  year  before  enrollment. 

To  test  our  hypothesis,  we  collected  agency-  and  county-level  data  for  1 994  fi-om  three  files  and 
the  Federal  Register.  To  assess  how  well  demonstration  participants  represented  other  agencies  in 
their  states,  we  calculated  descriptive  statistics  and  estimated  a  multivariate  regression  model.  The 
descriptive  analysis  compares  the  prevalence  of  selected  characteristics  among  participemts  and 
invited  nonparticipants  in  the  states  where  the  demonstration  was  implemented.  The  regression 
analysis  then  estimates  the  probability  that  an  agency  enrolled  in  the  demonstration  as  a  function  of 
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its  characteristics,  and  helps  us  assess  each  characteristic's  independent  effect  on  enrollment.  To 
determine  whether  participants  were  representative  of  home  care  agencies  around  the  nation,  we 
repeated  the  descriptive  analysis  using  participants  and  a  national  sample  of  eligible  nonparticipants. 

B.  FINDINGS 

In  brief,  our  analysis  of  demonstration  participation  shows  that: 

•  Compared  to  agencies  that  declined  to  participate  in  the  demonstration,  a  relatively  large 
percentage  of  agencies  that  did  participate  were  visiting  nurse  associations  or  other 
freestanding  agencies.  A  relatively  small  percentage  of  participants  were  based  in 
hospitals. 

•  Compared  to  agencies  that  chose  not  to  participate,  a  relatively  large  percentage  of 
participants  had  large  staffs,  long  Medicare  tenures,  and  provided  all  six  Medicare- 
covered  services. 

•  Participating  agencies  seemed  no  more  likely  than  invited  nonparticipants  to  have  had 
high  Medicare  costs  in  the  year  before  the  demonstration. 

•  Demonstration  participants  were  underrepresentative  of  small,  low-volume  agencies  in 
the  nation  at  large.  They  also  underrepresentfed  the  nation's  share  of  hospital-based  and 
nonmetropolitan  agencies.  Demonstration  participants,  however,  seemed  no  more  likely 
than  other  agencies  in  the  nation  to  have  had  high  per- visit  costs  or  to  have  exceeded 
their  cost  limits  in  the  year  before  the  demonstration. 

C.  LIMITATIONS  OF  THE  ANALYSIS 

Our  analysis  is  neither  exhaustive  nor  entirely  conclusive.  The  key  limitation  stems  from 
missing  data.  Agency-level  cost  data  were  not  available  for  57  percent  of  the  agencies  in  our 
analysis.  In  general,  cost  data  were  missing  because  (1)  an  agency  did  not  have  a  settled  cost  report 
that  coincided  with  our  period  of  observation,  or  (2)  an  agency  was  hospital-based  and,  as  a  result, 
its  cost  data  are  not  publicly  available.  If  agencies  without  cost  reports  differed  from  those  with  cost 
reports  in  ways  that  were  related  to  profitability  (and,  by  extension,  the  enrollment  decision),  then 
the  differences  we  observed  between  the  two  groups  would  be  biased.  In  addition,  although  we 
observed  many  similarities  between  participants  and  nonparticipants,  this  analysis  cannot  abate 
concern  over  unobservable  characteristics  that  may  have  influenced  agencies'  enrollment  decisions. 

D.  IMPLICATIONS  FOR  INTERPRETING  EVALUATION  RESULTS 

Our  analysis  shows  that,  while  participants  and  nonparticipants  differed  in  some  respects,  they 
also  shared  important  characteristics.  Moreover,  previously  conducted  impact  analyses  (Chen  2000; 
Trenhohn  2000a,  2000b;  Schore  2000;  and  Cheh  and  Black  2001)  do  not  provide  especially  sfrong 
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evidence  that  different  types  of  agencies  behave  differently  from  each  other  under  prospective 
payment.  In  addition,  since  HCFA  implemented  the  Interim  Payment  System,  in  1997,  the  national 
population  of  home  health  agencies  has  evolved  to  a  point  where  home  health  agencies  today  seem 
to  have  more  in  common  with  demonstration  participants  than  with  nonparticipants.  These  three 
factors  mitigate  concern  over  the  observed  differences  between  participants  and  nonparticipants. 
The  differences  do  not  seem  sufficient  cause  for  reinterpreting  impact  analyses,  nor  do  they  suggest 
that  the  demonstration's  cost-saving  potential  (relative  to  the  previous  fee-for-service  method)  would 
not  be  replicated  on  a  national  scale. 
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I.  INTRODUCTION 


Nationwide  prospective  payment  for  Medicare  home  health  care  has  been  in  effect  since 
October  1 , 2000.  With  the  program  so  recently  under  way,  policymakers  and  program  administrators 
are  likely  to  expect  that  the  consequences  of  the  change  in  payment  method  will  mirror  those  of  the 
five-state  demonstration  that  first  tested  the  method.  Indeed,  an  ongoing  evaluation  of  the 
demonstration  suggests  that  prospective  payment  is  a  promising  system  that  appears  to  reduce 
service  use  without  negatively  affecting  many  important  aspects  of  patient  care.  However,  there  are 
several  key  reasons  that  the  evaluation  findings  may  not  be  reflected  in  the  outcomes  fi*om  the 
nationwide  program. 

First,  the  program,  as  implemented,  differs  fi^om  the  one  tested.'  Second,  the  five-state 
demonstration  was  designed  to  compare  the  behavior  of  agencies  under  prospective  payment  with 
their  behavior  under  fee-for-service  payment;  however,  fee-for-service  was  itself  replaced,  in  1997, 
by  the  congressionally  mandated  Interim  Payment  System  (TPS).  While  the  evaluation  findings  are 
no  less  valid  because  of  the  change  in  payment  systems,  they  may  be  somewhat  less  relevant.  Third, 
agencies  that  chose  to  participate  in  the  demonstration  may  have  differed  fi-om  those  that  chose  not 
to  participate  or  that  were  not  invited  to  participate  because  they  were  not  in  a  demonstration  state. 
Given  that  participation  in  the  demonstration  was  voluntary,  that  the  demonstration  was 


'For  example,  to  attract  participants  into  the  Per-Episode  Prospective  Payment  Demonstration, 
the  Health  Care  Financing  Administration  (HCFA)  made  some  accommodations  which  it  knew 
could  not  be  retained  under  a  national  program,  such  as  protecting  participating  agencies  fi-om 
financial  losses  and  setting  prospective  payment  rates  according  to  each  agency's  prior  per-episode 
costs.  Additional  changes,  such  as  reducing  agencies'  at-risk  periods  fi^om  120  days  to  60,  were 
made  over  the  course  of  the  demonstration. 
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implemented  in  only  five  states,  and  that  fewer  than  10  percent  of  invited  agencies  chose  to  enroll, 
it  would  be  surprising  not  to  find  differences  between  participants  and  nonparticipants. 

Of  the  three  potential  limits  on  generalizability  just  identified,  the  ongoing  evaluation  mentioned 
on  the  previous  page  addresses  only  one.  It  cannot  control  for  differences  between  the  demonstration 
and  the  actual  program.  It  can,  however,  assess  whether  differences  between  demonstration 
participants  and  other  agencies  cast  doubt  on  the  generalizability  of  the  effects  of  the  prospective 
payment  demonstration,  relative  to  the  fee-for-service  system. 

To  make  such  an  assessment,  this  report  compares  the  characteristics  of  demonstration 
participants  with  those  of  two  other  groups:  (1)  other  agencies  in  the  five  demonstration  states  that 
were  invited  but  declined  to  participate;  and  (2)  those  nonparticipants,  plus  all  others  in  the  nation 
that  would  have  been  eligible  to  participate  were  they  located  in  a  demonstration  state.  For  the 
demonstration  states,  this  analysis  will  help  determine  whether  some  of  the  demonstration  outcomes 
may  be  attributable  to  agency  self-selection,  rather  than  to  the  payment  system  itself.  If  so,  state- 
level  generahzability  would  be  limited.  A  national  comparison  is  also  important,  for  the  following 
reason.  Even  if  the  agencies  that  agreed  to  participate  in  the  demonstration  were  representative  of 
all  the  agencies  invited  to  participate,  the  five-state  demonstration  sample  may  not  have  been 
representative  nationally.  If  the  demonstration  sample  differed  markedly  fi-om  the  national 
population,  findings  fi"om  the  demonstration  evaluation  would  have  limited  national  generahzability. 

A.   OVERVIEW  OF  THE  DEMONSTRATION 

The  Per-Episode  Home  Health  Prospective  Payment  Demonstration,  launched  in  1995,  tested 
an  altemative  method  of  paying  home  health  agencies  for  their  services  to  Medicare  beneficiaries. 
Specifically,  the  demonstration  was  designed  to  examine  whether  the  change  fi-om  a  retrospective 
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cost-reimbursement  payment  system  to  a  prospective  rate-setting  system  would  induce  agencies  to 
provide  home  health  care  more  efficiently. 

Under  the  demonstration,  agencies  were  paid  a  fixed,  lump  sum  amount  for  the  first  120  days 
of  home  health  care,  regardless  of  the  number  of  visits  provided  or  their  cost.  For  each  visit  after 
the  120-day  episode,  agencies  received  a  predetermined  fixed  payment.  The  episode  and  per- visit 
rates  differed  by  agency;  they  were  based  on  each  agency's  costs  in  the  year  prior  to  the 
demonstration.  By  allowing  agencies  to  retain  any  surplus  payments  over  cost,  prospective  payment 
gave  participating  agencies  an  incentive  to  provide  Medicare  services  in  a  cost-effective  maimer. 

1.  Agency  Recruitment 

Abt  Associates,  the  implementation  contractor,  recruited  potentially  eligible  home  health 
agencies  in  five  states— California,  Florida,  Illinois,  Massachusetts,  and  Texas— into  the 
demonstration.  When  agencies  expressed  interest  in  participating,  Abt  ascertained  their  eligibility 
and  invited  qualified  agencies  to  join  the  demonstration.  An  agency  was  eligible  if: 

•  It  was  a  nongovernmental  agency 

•  It  was  not  based  in  a  rehabilitation  or  skilled  nursing  facility 

•  It  had  been  certified  to  participate  in  Medicare  before  January  1 ,  1 992 

•  It  had  not  been  a  treatment  agency  in  HCFA's  earlier,  per- visit  demonstration 

•  Its  fiscal  year  began  between  May  3 1  and  January  2 

2.  Enrollment 

Ninety-one  eligible  agencies  enrolled  in  the  three-year,  per-episode  demonstration.  Of  these, 
47  were  randomly  assigned  to  the  treatment  group  to  receive  per-episode  payment;  the  remaining 
44  were  assigned  to  the  control  group  to  continue  receiving  cost  reimbursement.  One  control  agency 
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switched  into  the  treatment  group  early  in  the  demonstration,  for  a  revised  total  of  48  treatment 
agencies  and  43  control  agencies.  Each  agency  entered  the  demonstration  at  the  start  of  its  fiscal 
year— between  June  1995,  at  the  earUest,  and  January  1996,  at  the  latest.  Treatment  group  agencies 
began  receiving  prospective  payment  upon  enrollment,  continuing  to  do  so  until  the  new  system  was 
implemented.  For  control  agencies,  the  demonstration  operated  through  December  1998. 

B.   RESEARCH  HYPOTHESES 

The  designers  of  the  demonstration  expected  each  invited  agency  to  base  its  enrollment  decision 
largely  on  the  agency's  perception  of  its  potential  to  earn  profits  under  prospective  payment. 
Because  an  agency's  profitability  is  related  to  the  characteristics  of  its  structure,  services,  finances, 
and  environment,  we  hypothesize  that  those  agencies  that  chose  to  participate  were  different  from 
those  that  declined,  with  regard  to  these  characteristics.  Our  hypotheses  are  described  further  below. 

1.    Structural  Characteristics 

An  agency's  desire  and  capacity  to  enroll  in  the  demonstration  may  have  been  related  to 
structural  characteristics  such  as  its  organizational  mission,  previous  Medicare  experience,  and  staff 
size.  Agencies  with  a  mission  to  earn  profits  for  their  owners  or  shareholders  may  have  been 
particularly  responsive  to  this  demonstration  because  it  featured  a  profit  motive.  Certain  agencies 
with  less  profit-focused  organizational  missions  may  also  have  been  attracted  to  the  demonstration 
at  higher  rates  than  were  other  agencies.  Agencies  run  by  visiting  nurse  associations,  for  example, 
have  said  that  the  opportunity  to  contribute  to  policy  learning  by  participating  in  the  demonstration 
appealed  to  them  (Phillips  and  Thompson  1997).  By  contrast,  hospital-based  home  health  agencies 
may  have  had  a  different  response  to  the  demonstration  incentives.  For  instance,  if  a  hospital-based 
agency  existed  principally  to  increase  patient  satisfaction  with  the  hospital  system,  the  agency  might 
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have  declined  to  join  the  demonstration  because  of  the  incentive  to  reduce  visits  (Trenholm  2000b). 
Or,  a  hospital-based  agency  may  have  had  little  interest  in  the  demonstration  simply  because  agency 
revenues  were  a  relatively  small  fraction  of  hospital  revenues. 

An  agency's  willingness  to  participate  in  the  demonstration  may  also  have  been  directly  related 
to  its  length  of  Medicare  participation  when  it  was  invited  to  enroll.  To  be  eligible  for  the 
demonstration,  agencies  needed  a  minimum  Medicare  participation  of  three  and  a  half  years.  Even 
with  this  level  of  experience,  however,  some  agencies  may  have  felt  that  they  lacked  sufficient 
understanding  of  Medicare  to  withstand  an  alternative  payment  system.  Among  demonstration 
participants,  we  expect  to  see  a  relatively  large  proportion  of  agencies  with  more  than  10  years' 
Medicare  experience,  as  well  as  a  relatively  small  proportion  of  less  experienced  agencies. 

We  also  expect  that  agencies  with  large  staffs  may  have  responded  differently  to  the 
demonstration  incentives  than  smaller  agencies  did;  but  the  direction  of  such  a  difference  is  difficult 
to  predict.  For  example,  larger  agencies  may  have  found  it  relatively  more  difficult  to  communicate 
with  their  employees,  thus  making  it  more  difficult  to  implement  systemic  changes  in  care  patterns 
(Trenholm  2000b).  On  the  other  hand,  larger  agencies  may  have  been  more  likely  than  small 
agencies  to  automate  data  and  billing  systems  and  thus  may  have  found  the  data-collection  and 
paperwork  demands  of  the  demonstration  less  burdensome. 

2.    Service  Characteristics 

Medicare  covers  six  home  health  services— skilled  nursing,  home  health  aide  visits,  physical 
therapy,  speech  therapy,  occupational  therapy,  and  medical  social  visits— which  an  agency  may 
provide  with  its  own  staff,  through  a  contractual  arrangement  with  another  organization,  through 
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both  methods,  or  not  at  all.'^  Agencies  that  provide  all  six  services  would  have  greater  control  than 
other  agencies  over  the  type  and  amount  of  services  they  provide;  agencies  that  provide  all  six 
services  with  their  own  staff  would  have  optimal  control.  Because  the  ability  to  control  Medicare 
service  provision  is  key  to  making  money  under  prospective  payment,  we  expect  full-service 
agencies  to  have  joined  the  demonstration  at  higher  rates  than  other  agencies. 

We  also  believe  that  the  risks  associated  with  prospective  payment  would  have  been  less 
worrisome  to  high-volume  agencies  (those  providing  at  least  30,000  Medicare  visits  annually)  than 
to  low-volume  agencies.  While  large  agencies  may  be  able  to  absorb  financial  losses  associated  with 
episodes  of  high-cost  care,  a  few  such  episodes  would  disproportionately  affect  small  agencies. 
Thus,  we  expect  a  relatively  large  percentage  of  participants  to  have  provided  high  volumes  of 
Medicare  services  in  the  year  before  the  demonstration. 

3.    Financial  Characteristics 

Only  agencies  that  could  reduce  their  predemonstration  costs  would  benefit  under  the 
demonstration.  As  noted  above,  prospective  payment  rates  used  in  the  demonstration  were  based 
on  agencies'  base-year  costs.  As  a  result,  for  the  same  base  year,  agencies  with  lower  base-year  per- 
visit  costs  were  paid  less  per  episode.  Low-cost  agencies  would  have  had  greater  difficulty  reducing 
their  episode  costs  under  the  demonstration;  thus,  they  would  have  been  less  likely  than  high-cost 
agencies  to  make  a  profit,  and  they  may  have  been  less  likely  to  enroll.  (However,  the 
demonstration's  loss  protection  feature  minimized  financial  risk  for  all  agencies.) 

It  is  also  plausible  that  participants  were  more  likely  than  nonparticipants  to  participate  in  the 
Medicaid  program.  Under  the  demonstration,  a  unique  (albeit  unintended)  source  of  potential  profits 

^Agencies  must  provide  skilled  nursing  services  and  at  least  one  therapy  service,  under  Section 
1861[42  U.S.C.  1395x]  PartD. 
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stemmed  from  serving  clients  dually  eligible  for  Medicare  and  Medicaid  benefits.  Depending  on 
the  rules  of  the  Medicaid  program  in  its  state,  an  agency  could  commence  a  Medicare-covered  care 
episode  to  generate  a  prospective  per-episode  payment  and  then,  before  the  end  of  the  120-day 
episode,  legitimately  transfer  the  client  to  Medicaid  services.^  Doing  so  would  generate  a  Medicaid 
reimbursement,  assuming  that  the  client  qualifies  for  Medicaid  services.  By  thus  "gaming"  the 
system,  an  agency  would,  in  effect,  collect  Medicare  and  Medicaid  payments  for  the  same  client. 

4.    Environmental  Characteristics 

Area  characteristics,  and  even  regional  health  care  approaches,  could  have  affected  the  way 
agencies  perceived  their  potential  profitability  under  the  demonstration.  For  example,  metropolitan 
agencies  may  have  planned  to  reduce  admissions  from  remote  areas,  thereby  lowering  their  fravel 
expenses  and  raising  their  profits.  It  is  also  possible  that  agencies  with  large  pools  of  potential 
admissions,  such  as  those  serving  areas  with  a  high  percentage  of  elderly  or  otherwise  disadvantaged 
residents,  may  have  been  more  willing  than  other  agencies  to  join  the  demonstration.  Finally,  the 
availability  of  alternatives  to  home  health  care  may  have  shaped  responses  to  the  demonstration.  For 
example,  in  areas  with  an  ample  supply  of  nursing  home  beds,  agencies  may  have  planned  to  reduce 
their  per-episode  Medicare  visits,  and  boost  their  profits,  by  increasing  their  referrals  of  very  ill 
patients  to  nursing  homes. 


^For  example,  before  the  demonstration,  some  agencies  may  have  customarily  transferred  clients 
from  Medicare  to  Medicaid  when  they  no  longer  required  skilled  nursing  services. 
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II.  SAMPLES,  DATA,  AND  ANALYTIC  APPROACH 


A.  SAMPLES 

As  noted  in  Chapter  I,  this  analysis  compares  demonstration  "participants"  with  "invited 
nonparticipants"  and  "eligible  nonparticipants."  We  define  participants  as  home  health  agencies  that 
participated  in  the  demonstration  for  at  least  one  month;  there  were  88  participants.'^  We  define 
invited  nonparticipants  as  home  health  agencies  in  the  five  demonstration  states  of  California, 
Florida,  Illinois,  Massachusetts,  and  Texas  that  met  the  demonstration's  eligibility  criteria  (see 
Chapter  I)  and  were  invited  to  enroll  but  declined  to  do  so;  there  were  1,036  invited  nonparticipants. 
Eligible  nonparticipants  are  defined  as  agencies  that  met  the  demonstration's  eligibihty  criteria 
whether  or  not  they  actually  were  in  a  demonstration  state.  This  group  includes  the  1,036  invited 
nonparticipants  fi^om  the  demonstration  states,  plus  2,835  agencies  fi^om  the  45  nondemonstration 
states  (and  Puerto  Rico),  for  a  total  of  3,871  eligible  agencies  nationwide. 

B.  DATA 

1.    Available  Variables  and  Their  Sources 

To  test  our  hypothesis  that  demonstration  participants  were  more  likely  than  nonparticipants  to 
possess  certain  structural,  service,  financial,  and  environmental  characteristics  in  the  year  before 
demonstration  enrollment,  we  drew  agency-  and  county-level  data  for  1994  fi"om  three  public-use 
sources  and  the  Federal  Register.  Table  11. 1  presents  a  list  of  variables  included  in  the  analysis,  as 
drawn  from: 


''Our  analysis  excludes  two  control  agencies  and  one  treatment  agency  that  withdrew  fi-om  the 
demonstration  during  the  first  month  of  implementation.  These  agencies  were  either  purchased  by 
or  merged  with,  another  agency,  and  the  new  ownership  did  not  want  to  participate. 
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TABLE  II.  1 
VARIABLES  USED  IN  THE  ANALYSIS 


Structural 

Environmental 

Characteristics 

Service  Provision 

Financial  Characteristics 

Characteristics 

Source: 

Source: 

Source: 

Source: 

1994  Provider  of 

Section  223  Cost  Limit  File 

Section  223  Cost  Limit 

2000  Area  Resource  File 

Services  File 

(Cycles  15  and  16) 

File  (Cycles  15  and  16) 

Percent  in  a  Metropolitan 

Provider  Type: 

Average  Number  of 

Median  Cost  per 

Statistical  Area 

Hospital-based 

Medicare  Visits  (for  each 

Medicare  Visit  (for  each 

Visiting  nurses 

of  six  services) 

of  six  services) 

Percent  of  County 

association 

Population  Over  Age  65 

Other  freestanding 

Percent  Distribution  of 

Visits  (for  six  services) 

Source: 

Percent  of  County 

Proprietary  Status: 

Federal  Register 

Population  That  Is  Black 

For-profit 

Nonprofit 

Source: 

Cost-to-Cost-Limit  Ratio 

Average  Annual  Per- 

1994  Provider  of  Services 

Capita  Income  (in  1994 

Length  of  Participation 

File 

Average  of  Ratios 

dollars) 

in  Medicare: 

Less  than  5  years 

Services  Offered: 

Distribution  of  Ratios 

Unemployment  Rate 

5  to  10  years 

Nursing 

Under  75  percent 

More  than  10 

Physical  therapy 

75  to  84  percent 

Physicians  per  1,000 

years 

Occupational 

85  to  99  percent 

Population 

therapy 

100  to  114 

Average  Number  of 

Speech  therapy 

percent 

Average  Nursing  Home 

Health  Care  Staffs 

Medical  social 

1 1 5  percent  or 

Beds  per  1,000  Elderly 

services 

more 

(1991) 

Percent  of  All  Staff: 

Home  health  aide 

Health  care 

services 

Source: 

Average  Hospital 

Other 

1994  Provider  of 

Occupancy  Rates 

Services  File 

Percent  of  Health  Care 

Average  Medicare 

Staff: 

Participates  in  the 

Reimbursements  per 

Registered  nurses 

Medicaid  Program 

Beneficiary  (1991) 

Licensed  practical 

Yes 

nurses 

No 

Physical  therapists, 

speech  pathologists. 

and  audiologists 

Social  workers 

Home  health  aides 

^Health  care  staff  mclude  registered  nurses,  licensed  practical  nurses,  occupational  therapists,  physical  therapists, 
audiologists,  speech  pathologists,  social  workers,  home  health  aides,  pharmacists,  and  dieticians.  Other  staff  include 
all  those  not  otherwise  specified. 
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•  The  1994  Provider  of  Services  File.  This  file,  made  available  by  HCFA,  contains 
agency-level  information  on  all  home  health  agencies  that  were  Medicare-  or  Medicaid- 
certified  in  1994,  and  their  characteristics  at  that  time. 

•  The  Section  223  Cost  Limit  File  ( Cycles  15  and  1 6).  These  files  provided  agency-level 
cost  information  for  the  year  preceding  the  demonstration  enrollment  period.  Section 
223  Cost  Limit  Files  are  made  available  by  HCFA.  They  contain  the  cost,  statistical, 
and  other  data  used  to  establish  the  Home  Health  Agency  (HHA)  Cost  Limits.  Cycle 
15  is  based  on  data  obtained  fi-om  the  Free  Standing  Medicare  HHA  Cost  Reports  for 
full  cost  reporting  periods  beginning  on  or  after  January  1 ,  1 994,  and  settled  by  May 
1998.  Cycle  16  covers  fiill  cost  reporting  periods  beginning  on  or  after  October  1,  1994, 
and  settled  by  March  1999.  If  cost  reports  appeared  in  both  cycles  for  the  same  agency, 
we  used  the  most  recent  information,  fi^om  Cycle  16. 

•  The  Federal  Register.  We  obtained  HCFA's  standard  cost  limits  for  each  of  the  six 
Medicare-covered  home  health  services  from  the  Federal  Register  (February  14,  1995, 
vol.  60,  no.  30),  and  followed  instructions  therein  to  adjust  each  cost  limit  for  regional 
costs  of  living,  wage  indices,  budget  neutrality,  and  reporting  year  start  dates.^ 

•  The  2000 Area  Resource  File.  The  Area  Resource  File  is  made  available  by  the  Bureau 
of  Health  Professions.  It  provides  preenrollment,  county-level  demographic  and  health 
care  supply  data  for  the  agencies  in  our  sample.  Data  are  from  1 994,  except  where 
noted. 


2.    Missing  Data 

The  Section  223  Cost  Limit  Files  (our  source  of  data  on  the  volume  and  costs  of  agencies' 
Medicare-covered  services)  did  not  include  settled  cost  reports  for  over  half  the  agencies  in  our 
analysis.  There  are  two  main  reasons  why  an  agency  in  our  analysis  would  not  have  a  cost  report. 
Either  the  agency  was  hospital-based,  and  therefore  the  cost  report  is  not  included  in  the  223  Cost 
Limit  File;  or  the  agency  was  freestanding  but  its  cost  report  was  not  settled  by  the  cut-off  dates  for 
inclusion  in  either  Cycle  15  or  Cycle  16  of  the  Section  223  Files.  Among  the  agencies  in  our 


^Adjustments  for  reporting  year  start  dates  were  only  necessary  for  agencies  with  a  reporting 
year  start  date  of  June  1,  1994. 
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analysis  that  did  not  have  cost  reports,  about  40  percent  were  hospital-based  and  60  percent  were 
freestanding  (see  Table  11.2).^ 

The  proportions  of  agencies  with  and  without  settled  cost  reports  were  not  evenly  distributed 
across  demonstration  participants  and  nonparticipants.  Nonparticipants  were  more  likely  than 
participants  not  to  have  a  cost  report  (58  percent  of  all  nonparticipants  did  not  file  a  cost  report, 
versus  20  percent  of  participants;  see  Table  11.2).  Furthermore,  even  among  agencies  with  settled 
cost  reports,  a  considerable  percentage  were  missing  specific  data  elements,  such  as  the  agency's 
average  per-visit  cost  for  one  or  more  Medicare-covered  service.  Again,  compared  to  the  reports  of 
demonstration  participants,  the  reports  of  nonparticipants  were  more  likely  to  be  missing  data 
elements.  We  discuss  the  possible  implications  of  missing  cost  reports  and  missing  data  elements 
in  the  next  section  of  this  chapter. 

C.   ANALYTIC  APPROACH  AND  LIMITATIONS 
1.    Analytic  Approach 

To  assess  how  well  demonstration  participants  represented  other  agencies  in  their  states,  we 
calculated  descriptive  statistics  and  estimated  a  multivariate  regression  model.  For  the  descriptive 
analysis,  we  calculated  the  mean  or  median  value  of  each  characteristic  for  participants  and  invited 
nonparticipants.  We  used  t-tests  or  nonparametric  tests  to  assess  the  statistical  significance  of  any 
differences  between  the  values  for  the  two  groups.  Calculating  the  mean  (or  median)  values 
illustrates  the  structural,  financial,  service,  and  environmental  characteristics  of  typical  participants 


^Among  fi-eestanding  agencies,  those  that  belong  to  chains  may  be  more  likely  than  others  not 
to  have  a  settled  cost  report  by  a  given  time  because  their  reports  cannot  be  settled  until  after  the 
home  office's  report  is  settled. 
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and  invited  nonparticipants.  Testing  the  statistical  significance  of  any  differences  between  those 
values  helps  us  identify  those  characteristics  that  may  truly  affect  the  likelihood  of  participation. 

Multivariate  regression  allows  us  to  estimate  the  effect  of  each  characteristic  on  agencies' 
enrollment  decisions,  while  holding  other  effects  constant.  By  predicting  the  probability  that  an 
agency  chose  to  enroll  in  the  demonstration  as  a  function  of  its  characteristics,  regression  analysis 
provides  an  alternative  way  to  imderstand  how  certain  characteristics  affected  enrollment.  The 
descriptive  analysis,  by  contrast,  simply  compares  the  prevalence  of  those  characteristics  across 
participants  and  invited  nonparticipants.  In  our  logistic  regression  model,  we  regressed  a  binary 
dependent  variable  (whether  or  not  an  agency  enrolled  in  the  demonstration)  against  characteristics 
whose  mean  values  were  statistically  different  for  participants  and  nonparticipants  in  our  descriptive 
analysis.^'  ^ 

,  Finally,  to  determine  whether  participants  were  representative  of  home  care  agencies  around  the 
nation,  we  repeated  the  descriptive  analysis  using  participants  and  the  national  sample  of  eligible 
nonparticipants. 

2.    Limitations  of  the  Analysis 

The  key  limitation  in  this  analysis  stems  from  the  fact  that  we  know  little  about  the  volume  and 
cost  of  Medicare  visits  provided  by  a  large  proportion  of  agencies  in  our  sample.  As  Table  II.2 


^We  constructed  binary  variables  for  the  regression  analysis.  These  variables  indicate  whether 
an  agency  was  run  by  a  visiting  nurse  association,  provided  all  six  Medicare  home  health  services, 
had  participated  in  Medicare  for  10  years  or  more  at  the  time  of  enrollment,  and  had  a  cost-to-cost- 
limit  ratio  of  .95  or  higher.  The  model  omits  a  variable  to  indicate  high  or  low  service  volume 
because  this  variable  is  highly  correlated  with  whether  or  not  an  agency  provided  all  six  Medicare 
home  health  services;  that  is,  the  two  variables  seem  to  measure  similar  phenomena. 

^The  regression  analysis  excluded  eligible  nonparticipants  in  the  nondemonstration  states 
because  they  did  not  actually  make  an  enrollment  decision. 
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shows,  35  percent  (31)  of  the  88  participating  agencies  were  either  missing  cost  reports  altogether 
or  had  cost  reports  that  were  missing  key  data  elements.  Even  more  striking,  71  percent  (2,740)  of 
eligible  nonparticipating  agencies  were  missing  cost  reports  or  were  missing  volume  or  cost  data. 
If  agencies  that  were  missing  cost  reports  or  data  elements  were  different  from  agencies  with 
complete  cost  reports,  our  results  could  be  substantially  biased.  For  example,  if  agencies  with 
missing  per-visit  cost  data  actually  tended  to  have  below-average  costs,  then  the  differences  between 
the  per-visit  costs  of  participants  and  nonparticipants  that  we  have  estimated  would  be  too  small,  and 
our  results  would  be  less  generalizable  than  we  imply.  Furthermore,  our  analysis  of  the  volume  and 
cost  of  visits  provided  by  participants  versus  nonparticipants,  whether  biased  or  not,  excludes 
hospital-based  agencies,  which  are  not  included  in  the  223  Cost  Limit  File.  Thus,  our  findings  about 
the  volume  and  costs  of  visits  should  be  viewed  cautiously  because  of  the  threat  of  bias,  and  they 
may  not  be  at  all  applicable  to  hospital-based  agencies. 

In  our  logistic  regression  analysis,  we  were  able  to  avoid  biased  estimates  of  the  effects  of  cost 
characteristics  on  agency  participation  by  including  in  our  model  a  binary  variable  to  indicate 
whether  an  agency  was  missing  data  on  whether  it  was  above  its  cost  limit  in  the  year  before  the 
demonstration.^ 


^We  also  considered  whether  we  might  mitigate  some  of  the  problems  associated  with  missing 
volume  and  cost  data  by  weighting  the  observations  we  used  in  Tables  III. 3,  III.4,  III. 9,  and  III.  10. 
Because  we  observed  that  agencies  in  East  Coast  states  were  more  likely  than  agencies  in  many  other 
states  to  have  settled  cost  reports,  we  weighted  observations  in  order  to  compensate  for  the 
geographic  bias  in  the  sample  of  agencies  with  settled  cost  reports.  We  found  that  our  weighted 
results  were  similar  to  our  unweighted  (reported)  results.  While  we  observed  some  changes  in  the 
magnitude  of  the  differences  between  participants  and  nonparticipants,  the  changes,  in  both  the 
differences  and  p-values,  were  materially  small.  Sensitivity  tests,  in  which  we  compared  unweighted 
and  weighted  mean  per-visit  costs  and  unweighted  and  weighted  median  per-visits  costs,  also  failed 
to  produce  more  than  one  or  two  statistically  significant  difference  between  participants  and 
nonparticipants  in  both  the  five-state  and  national  comparisons. 
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Finally,  we  would  recommend  that  any  additional  analysis  of  participation  include  data  on 
agencies'  average  number  of  visits  per  episode  (or  per  user)  in  the  base  year.  An  agency's  ability 
to  reduce  visits  per  episode  is  likely  to  have  been  a  key  factor  in  the  enrollment  decision  and  in  its 
potential  to  earn  profits.  Unfortunately,  such  service-use  data  are  expensive  to  obtain  and  thus  were 
omitted  fi-om  this  analysis. 
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III.  RESULTS 


A.   FINDINGS  FROM  THE  DEMONSTRATION  STATES 
1.    Structural  Characteristics 

With  respect  to  agencies'  structural  characteristics,  we  hypothesized  that  demonstration 
enrollment  varied  among  agencies  with  different  organizational  missions,  varying  Medicare 
experience,  and  staff  composition.  We  found  that,  compared  to  agencies  that  declined  to  join  the 
demonstration,  participating  agencies  were  more  likely  to  be  large,  freestanding  agencies  with  a  long 
Medicare  tenure  (see  Table  III.l).  Eighty-eight  percent  of  demonstration  participants  were 
freestanding  agencies,  including  many  visiting  nurse  associations  (35  percent).  Only  12  percent  of 
participants  were  based  in  hospitals,  compared  to  28  percent  of  invited  nonparticipants.'° 
Participants  were  10  percentage  points  less  likely  than  invited  nonparticipants  to  be  for-profit 
organizations.  This  finding,  which  is  contrary  to  our  expectations,  may  be  attributable  to  the  high 
percentage  of  visiting  nurse  associations  among  participants;  visiting  nurse  associations  are  nonprofit 
entities.  Participants  had  larger  staffs— 50  percent  larger,  on  average,  than  nonparticipants. 
Employees  were  similarly  distributed  among  health  care  and  other  workers,  and  among  various 
health  care  roles,  in  both  groups.  Finally,  71  percent  of  agencies  that  chose  to  enroll  in  the 
demonstration  had  participated  in  Medicare  for  at  least  1 0  years  before  enrolling.  A  significantly 
smaller  percentage  of  nonparticipants  (57  percent)  had  the  same  length  of  experience.  Only  10 


'°The  finding  that  invited  nonparticipants  were  16  percentage  points  more  likely  than 
participants  to  be  hospital-based  is  drawn  from  provider-type  data  in  the  POS  file.  If  the  223  Cost 
Limit  File  were  used  in  tandem  with  the  POS  file  to  determine  provider-type,  we  estimate  that  the 
difference  would  be  between  13  and  14  percentage  points.  See  Appendix  A  for  details. 
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TABLE  III.l 


STRUCTURAL  CHARACTERISTICS  OF  PARTICIPANTS 
AND  INVITED  NONPARTICIPANTS,  1994 
(Percentages,  except  where  noted) 


Characteristic 


Participants 


Invited 
Nonparticipants 


Difference 


p-Value^ 


Provider  Type"' 


Hospital-based 

11.6 

27.6 

-16.0 

.001 

Visiting  nurses  association 

34.9 

10.8 

24.1 

.000 

Other  freestanding 

ol.o 

O  1 

-o.l 

.140 

Proprietary  Status 

For  profit 

47.7 

57.5 

-9.8 

.075 

Length  of  Participation  in  Medicare 

Less  than  5  years 

10.2 

13.7 

-3.5 

.359 

5  to  10  years 

19.3 

29.7 

-10.4 

.039 

More  than  1 0  years 

70.5 

56.6 

13.9 

.011 

Staff  Composition 

Average  Number  of  Health  Care  Staff 

61.8 

41.3 

20.5 

.073 

Percent  of  All  Staff" 

Health  care 

88.9 

89.5 

-0.6 

.723 

Other 

11.1 

10.5 

0.6 

.723 

Percent  of  Health  Care  Staff 

Registered  nurses 

44.1 

46.4 

-2.3 

.251 

Licensed  practical  nurses 

10.9 

11.1 

-0.2 

.900 

Therapists,  audiologists,  and  speech 

pathologists 

8.5 

7.3, 

1.2 

.235 

Social  workers 

2.9 

2.2 

0.7 

.120 

Home  health  aides 

32.9 

32.5 

0.4 

.810 

Number  of  Agencies 

88 

1,036 

Source:     1 994  Provider  of  Services  File. 


^The  p- value  is  the  a  priori  probability  of  observing  a  difference  in  means  or  distributions  as  large  as  that  obtained  for 
the  sample  if  the  participating  and  nonparticipating  agencies  were  drawn  randomly  from  the  same  population. 

''Tabulations  for  this  variable  exclude  two  participating  agencies  with  missing  data. 

"Health  care  staff  include  registered  nurses,  licensed  practical  nurses,  occupational  therapists,  physical  therapists, 
audiologists,  speech  pathologists,  social  workers,  home  health  aides,  pharmacists,  and  dieticians.  Other  staff  include 
all  those  not  otherwise  specified. 
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percent  of  participants  had  less  than  five  years'  experience  (at  least  three-and-one-half  years' 
experience  was  needed  to  enroll). 

2.    Service  Provision 

Because  large,  full-service  agencies  may  have  greater  control  over  Medicare  service  provision 
than  small  agencies  that  must  contract  out  for  some  Medicare  services  or  do  not  provide  them  at  all, 
we  expected  to  see  a  relatively  high  percentage  of  such  agencies  among  demonstration  participants. 
Our  results  confirm  these  expectations.  A  higher  proportion  of  participants  than  invited 
nonparticipants  provided  each  of  the  six  Medicare-covered  services  with  in-house  staff,  though  not 
all  of  the  differences  were  statistically  significant  (see  Table  III.2).  Nearly  all  agencies  provided 
nursing  and  home  health  aide  services  with  in-house  staff.  Compared  to  nonparticipants,  however, 
participants  were  substantially  more  likely  to  provide  speech  therapy  and  medical  social  services, 
and  somewhat  more  likely  to  provide  occupational  therapy,  with  in-house  staff  In  addition, 
participants  were  more  likely  than  nonparticipants  to  provide  all  six  Medicare  services  with  in-house 
staff  or  through  contracts  (42  percent  of  participants  did,  versus  30  percent  of  nonparticipants). 
Participants  were  also  more  likely  to  have  provided  all  six  services  with  in-house  staff  exclusively 
(18  percent  of  participants  did,  versus  12  percent  of  nonparticipants;  data  not  shown). 

Compared  to  invited  nonparticipants,  participating  agencies  provided  more  of  each  Medicare- 
covered  service  in  the  year  before  demonstration  enrollment.  Participants  provided  an  average  of 
71,500  total  Medicare  visits,  about  66  percent  more  than  the  average  nonparticipant  (see  Table  III.3). 
Similarly  large  differences  are  observed  for  each  type  of  Medicare  visit.  Despite  this  difference  in 
the  volume  of  visits  provided  by  participants  and  nonparticipants,  both  groups  provided  similar 
distributions  of  visits.  Both  groups  provided  about  43  percent  nursing  visits,  48  percent  home  health 
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TABLE  IIL2 


MEDICARE  HOME  HEALTH  SERVICES  OFFERED  BY  PARTICIPANTS 
AND  INVITED  NONPARTICIPANTS,  1994 
(Percentages) 


Invited 

Services  Offered  Participants  Nonparticipants   Difference  p-Value' 


Nursing: 


By  staff 

100.0 

99.9 

0.1 

.771 

Not  provided 

0.0 

0.0 

0.0 

Physical  Therapy: 

By  staff 

68.2 

62.7 

4.5 

.310 

Not  provided 

4.5 

6.5 

-2.0 

.477 

Occupational  Therapy: 

By  staff 

54.5 

45.9 

8.6 

.121 

Not  provided 

18.2 

20.9 

-2.7 

.540 

Speech  Therapy: 

By  staff 

54.5 

40.9 

13.6 

.013 

Not  provided 

15.9 

16.1 

-0.2 

.959 

Medical  Social  Services: 

By  staff 

72.7 

62.3 

10.4 

.051 

Not  provided 

5.7 

13.5 

-7.8 

.035 

Home  Health  Aide  Services: 

By  staff 

98.9 

95.1 

3.8 

.105 

Not  provided 

1.1 

3.2 

-2.1 

.282 

Provided  All  Six  Services'' 

42.0 

29.7 

12.3 

.016 

Number  of  Agencies 

88 

1,036 

Source:  1 994  Provider  of  Services  File. 

^  The  p-value  is  the  a  priori  probability  of  observing  a  difference  in  means  or  distributions  as  large 
as  that  obtained  for  the  sample  if  the  participating  and  nonparticipating  agencies  were  drawn 
randomly  from  the  same  population. 

Includes  agencies  that  provided  all  six  services  with  in-house  staff  or  through  contracts. 
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TABLE  III.3 


NUMBER  AND  DISTRIBUTION  OF  VISITS  PROVIDED  BY  PARTICIPANTS 
AND  INVITED  NONPARTICIPANTS,  FOR  FISCAL  YEARS 
ENDING  BETWEEN  MAY  1995  AND  DECEMBER  1995 


Invited 

Variable  Participants  Nonparticipants  Difference  p-Value^ 


Average  Number  of  Medicare 
Visits'' 


Total 

71,491 

43,135 

28,356 

.000 

Home  Health  Aide  Services 

1A  A1  /I 

1  1  ACil 

.004 

Nursing 

30,136 

18,451 

11,685 

.000 

Physical  Therapy 

5,448 

3,082 

2,366 

.000 

Occupational  Therapy 

850 

468 

382 

.000 

Medical  Social  Services 

694 

428 

266 

.002 

Speech  Therapy 

347 

184 

163 

.000 

Distribution  of  Visits 

Percent  Home  Health  Aide  Services 

42.3 

44.2 

-1.9 

.304 

Percent  Nursing 

46.2 

45.9 

0.3 

.841 

Percent  Physical  Therapy 

8.4 

7.5 

0.9 

.245 

Percent  Occupational  Therapy 

1.4 

1.1 

0.3 

.082 

Percent  Medical  Social  Services 

1.1 

1.0 

0.1 

.181 

Percent  Speech  Therapy 

0.6 

0.4 

0.2 

.017 

Number  of  Agencies 

70 

452 

Source:  223  Cost  Limit  File  (Cycles  15  and  16). 

NOTE:  The  statistics  in  this  table  are  based  on  fewer  agencies  than  in  other  tables  because  of 
missing  cost  reports.  In  general,  data  are  missing  because  (1)  an  agency  was  hospital- 
based  and  therefore  not  required  to  file  a  cost  report,  or  (2)  an  agency  did  not  have  a 
settled  cost  report  that  coincided  with  the  period  of  observation  for  this  analysis. 

^The  p-value  is  the  a  priori  probability  of  observing  a  difference  in  means  or  distributions  as  large 
as  that  obtained  for  the  sample  if  the  participating  and  nonparticipating  agencies  were  drawn 
randomly  from  the  same  population. 

''All  agencies  were  weighted  equally  in  the  calculation  of  the  averages.  That  is,  agencies  that  did  not 
offer  a  particular  service  were  considered  to  have  zero  visits  of  that  type;  but  the  agency  itself  was 
included  in  (the  denominator  of)  our  calculations  of  averages. 
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aide  visits,  and  8  percent  physical  therapy  visits.  Occupational  therapy,  speech  therapy,  and  medical 
social  services  made  up  the  remaining  visits. 

3.    Financial  Characteristics 

Under  prospective  payment,  an  agency's  ability  to  lower  its  per- visit  costs  could  affect 
profitability  substantially.  We  hypothesized  that  agencies  with  relatively  high  predemonstration 
costs  might  have  had  greater  flexibility  to  lower  their  costs  and,  as  a  result,  would  have  joined  the 
demonstration  more  readily  than  agencies  that  were  already  keeping  their  costs  down.  Similarly,  we 
raised  the  possibility  that  agencies  that  participated  in  the  Medicaid  program  could  transfer  dually 
eligible  clients  from  Medicare  to  Medicaid  before  the  end  of  the  120-day  at-risk  period,  if  they  had 
done  so  before  the  demonstration  began. 

Among  agencies  with  cost  reports,  median  per-visit  costs  for  each  Medicare-covered  service 
were  roughly  equal  for  participants  and  nonparticipants,  with  the  exception  of  medical  social 
services  (see  Table  ni.4).  No  participant  exceeded  cost  limits  by  more  than  15  percent,  although  4 
percent  of  invited  nonparticipants  had  such  excessive  costs.  While  this  finding  suggests  that  the 
demonstration  participants  were  representative  of  other  agencies  in  their  states,  our  confidence  in 
the  finding  is  weakened  by  the  large  proportion  of  agencies  that  were  excluded  from  the  analysis 
because  of  missing  cost  reports.  Finally,  93  percent  of  participants  had  Medicaid  contracts, 
compared  to  90  percent  of  nonparticipants  (data  not  shown).  This  statistically  insignificant 
difference  suggests  that  the  potential  to  game  the  system  did  not  affect  agencies'  decisions  to  join 
the  demonstration. 
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TABLE  III.4 


COST  CHARACTERISTICS  FOR  PARTICIPANTS  AND  INVITED  NONPARTICIPANTS, 
FOR  FISCAL  YEARS  ENDING  BETWEEN  MAY  1995  AND  DECEMBER  1995 


Invited 

Characteristic  Participants  Nonparticipants  Difference  p-Value^ 


Median  Cost  per  Medicare  Visit'' 


Home  Health  Aide  Services 

$37.60 

$37.44 

$0.16 

.692 

Nursing 

$81.66 

$79.89 

$1.77 

.692 

Physical  Therapy 

$90.69 

$93.32 

-$2.63 

.417 

Occupational  Therapy 

coo 

Medical  Social  Services 

$134.84 

$114.61 

$20.23 

.076 

Speech  Therapy 

$93.53 

$94.41 

-$0.88 

1.00 

Cost-to-Cost-Limit  Ratio: 

Average  of  Ratios 

.81 

.85 

-0.04 

.449 

Distribution  of  Ratios 

Under  75  Percent 

28.4 

32.9 

-4.5 

.463 

75  to  84  Percent 

28.3 

23.9 

4.4 

.436 

85  to  99  Percent 

35.8 

29.8 

6.0 

.326 

100  to  114  Percent 

7.5 

9.3 

-1.8 

.637 

115  Percent  or  More 

0.0 

4.1 

-4.1 

.091 

Minimum  Number  of  Agencies' 

57 

300 

Source:  223  Cost  Limit  File  (Cycles  15  and  16). 

NOTE:  The  statistics  in  this  table  are  based  on  fewer  agencies  than  in  other  tables  because  of 
missing  cost  report  data.  In  general,  data  are  missing  because  (1)  an  agency  was  hospital- 
based  and  therefore  not  required  to  file  a  cost  report,  or  (2)  an  agency  did  not  have  a 
settled  cost  report  that  coincided  with  the  period  of  observation  for  this  analysis. 

^The  p-value  is  the  a  priori  probability  of  observing  a  difference  in  means,  medians,  or  distributions 
as  large  as  that  obtained  for  the  sample  if  the  participating  and  nonparticipating  agencies  were 
drawn  randomly  from  the  same  population. 

^Agencies  are  excluded  from  calculating  the  median  cost  of  a  given  type  of  visit  if  they  did  not 
render  that  type  of  visit. 

"Sample  sizes  vary  from  discipline  to  discipline  because  of  missing  data.  For  the  participants, 
sample  sizes  range  from  57  to  67;  for  invited  nonparticipants,  sample  sizes  range  from  300  to  389. 
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4.  Environmental  Characteristics 

Contrary  to  our  hypotheses,  participants  and  nonparticipants  operated  in  similar  environments 
(see  Table  III.5).  Demonstration  agencies  were  neither  more  nor  less  likely  than  nonparticipants  to 
serve  counties  with  relatively  large  proportions  of  residents  that  often  depend  the  most  on  Medicare 
(such  as  low-income  individuals).  Both  groups  also  seem  to  have  served  counties  with  similar  long- 
term  care  options,  as  indicated  by  the  supply  of  nursing  home  beds  and  other  health-care  supply  and 
demand  measures.  This  finding  suggests  that  participants  had  no  greater  opportunities  than 
nonparticipants  to  substitute  other  types  of  care  for  home  health  visits.  The  greatest  difference 
between  participants  and  nonparticipants  was  location— 84  percent  of  participants  operated  in 
metropolitan  areas,  compared  to  90  percent  of  nonparticipants. 

5.  The  Effects  of  Key  Characteristics  on  the  Decision  to  Participate 

With  the  results  of  the  descriptive  analysis  in  mind,  we  estimated  a  logistic  regression  model 
to  predict  the  probability  that  an  agency  would  choose  to  join  the  prospective  payment  demonstration 
as  a  function  of  its  characteristics.  We  learned  from  the  descriptive  analysis  that  demonstration 
participants  were  more  likely  than  invited  nonparticipants  to  have  been  (1)  visiting  nurses 
associations,  (2)  fiill-service  agencies,  (3)  below  their  cost  limits,  and  (4)  longstanding  participants 
in  the  Medicare  program."  We  also  learned  that  participants  were  less  likely  than  nonparticipants 
to  have  been  (1)  for-profit  agencies  and  (2)  located  in  metropolitan  areas. 

By  regressing  these  characteristics  against  each  agency's  enrollment  decision,  we  can  estimate 
the  probability  that  an  agency  would  have  enrolled  as  a  result  of  having  that  characteristic.  By  using  . 


"We  also  found  that  participants  provided  more  Medicare  visits  than  did  invited 
nonparticipants.  We  excluded  this  variable  from  our  regression  model,  however,  because  it  appeared 
to  be  measuring  the  same  phenomena  as  our  variable  to  indicate  whether  an  agency  was  full-service. 
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TABLE  III.5 

AREA  CHARACTERISTICS  FOR  PARTICIPANTS  AND  INVITED  NONPARTICIPANTS, 

1994 

(Except  where  noted) 


Characteristic 


Invited 

Participants   Nonparticipants  Difference  p-Value^ 


Percent  in  a  Metropolitan  Statistical 
Area  (MSA) 

County  Demographics 


84.1 


Percent  of  County  Population  Over 

Age  65  12.6 

Percent  of  County  Population  That 

Is  Black  12.3 

Economic  Indicators 

Average  Annual  Per-Capita  Income 

(in  dollars)  22,393 

Unemployment  Rate  6.6 

Healtli  Care  Supply  and  Use 

Physicians  per  1,000  Population  2.4 

Average  Nursing  Home  Beds  per 

1,000  Elderly  (1991)  42.5 

Average  Hospital  Occupancy  Rates  57.4 

Average  Medicare  Reimbursements 

per  Beneficiary  (1 99 1 )  (in  dollars)  3,387 


89.9 


13.3 
11.3 


21,923 
6.9 

2.3 

41.9 
58.7 

3,405 


-5.8 


-0.7 
1.0 


470 
-0.3 

0.1 

0.6 
-1.3 

-18 


.091 


.260 
.274 


.374 
.248 

.539 

.790 
.313 

.760 


Number  of  Agencies 


88 


1,036 


Source:  2000  Area  Resource  File;  223  Cost  Limit  File  (Cycles  15  and  16)  for  MSA  status. 

^The  p-value  is  the  a  priori  probability  of  observing  a  difference  in  means  or  distributions  as  large 
as  that  obtained  for  the  sample  if  the  participating  and  nonparticipating  agencies  were  drawn 
randomly  from  the  same  population. 
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a  multivariate  model,  we  isolate  the  effect  of  each  characteristic,  while  holding  constant  other 
characteristics  that  we  believe  affect  the  enrollment  decision.  If  the  presence  of  a  characteristic 
independently  affected  agencies'  enrollment  decisions,  we  would  expect  to  see  statistically 
significant  differences  between  the  predicted  probabilities  for  participants  and  invited 
nonparticipants. 

Our  regression  results  suggest  that  not  all  the  characteristics  that  varied  significantly  across 
participants  and  nonparticipants  independently  affected  the  probability  of  enrollment.  The 
characteristics  that  seemed  to  have  an  independent  effect  were  provider-type,  metropolitan-area 
status,  and  whether  the  agency  was  full-service  (defined  as  providing  all  six  Medicare-covered 
services  through  staff  or  contract)  (see  Table  111.6). 

More  specifically,  compared  to  other  agencies,  visiting  nurse  associations  were  six  percentage 
points  more  likely  to  have  joined  the  demonstration.  The  fact  that  neither  proprietary  status  nor 
Medicare  tenure  emerged  as  significant  predictors  of  the  enrollment  decision  suggests  that  we 
observed  large  percentages  of  agencies  with  nonprofit  status  and  long  Medicare  tenures  primarily 
because  we  also  observed  a  large  percentage  of  visiting  nurse  associations,  which  are  so 
characterized,  hi  addition,  fiill-service  agencies  were  four  percentage  points  more  likely  than  other 
agencies  to  have  joined  the  demonstration.  Metropolitan  agencies  were  seven  percentage  points  less 
likely  than  nonmetropolitan  agencies  to  have  joined. 

No  other  characteristic  had  more  than  a  three-point,  or  statistically  significant,  effect  on 
participation.  Although  our  descriptive  analysis  suggested  that  participants  were  more  likely  than 
invited  nonparticipants  to  be  below  their  cost  limits  in  the  year  before  enrollment,  our  regression 
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TABLE  III. 6 


ESTIMATED  EFFECT  OF  SELECTED  CHARACTERISTICS 
ON  THE  DECISION  TO  PARTICIPATE,  1994 


Predicted  Probability  of  Participating 
if  Characteristic  Is  Present 

Characteristic 

Participants 
(Percentage) 

Invited 
Nonparticipants 
(Percentage) 

Estimated 
Effect" 

p-Value'' 

Visiting  Nurses  Association*^ 

12.8 

6.6 

6.2 

.093 

For-Profit 

6.8 

9.1 

-2.3 

.325 

10  or  More  Years'  Medicare 
Participation 

8.6 

6.5 

2.1 

.263 

Provided  All  Six  Medicare  Services'" 

10.5 

6.6 

3.9 

.058 

Ratio  of  Costs  to  Cost  Limit  Less  than 
.95^ 

8.0 

7.8 

0.2 

.924 

In  a  Metropolitan  Statistical  Area 

7.2 

14.1 

-6.9 

.073 

Sample  Size  1,124 


Percent  That  Participated  in  the 

Demonstration  7.8 


Source:     The  1994  Provider  of  Services  File;  the  223  Cost  Limit  File  (Cycles  15  and  16);  the  Federal  Register 
(February  14,  1995);  and  the  2000  Area  Resource  File. 

*  The  estimated  effects  are  the  difference  between  the  average  predicted  probability  of  participating  in  the  demonstration 
if  the  characteristic  is  present,  each  calculated  over  all  sample  members. 

""The  p-value  is  the  a  priori  probability  of  observing  a  difference  as  large  as  that  obtained  for  the  sample  if  the 
participating  and  nonparticipating  agencies  were  drawn  from  the  same  population. 

■"Of  the  1,124  agencies  in  our  analysis,  56  were  coded  as  hospital-based  in  the  1994  Provider  of  Service  File  a«c/had 
data  in  the  223  Cost  Limit  File,  which  is  not  supposed  to  include  information  on  hospital-based  agencies.  For  this 
regression  analysis,  we  therefore  recoded  those  56  agencies  as  freestanding  agencies  (other  than  visitmg  nurses 
associations). 

Includes  agencies  that  provided  all  six  services  with  in-house  staff  or  through  contracts. 

^  Of  the  1,124  participants  and  invited  nonparticipants,  668  were  missing  their  cost-to-cost-limit  ratio  (a  variable  we 
constructed  with  data  from  the  223  Cost  Limit  Files).  To  obtain  unbiased  estimates  of  the  effect  of  that  variable  on 
participation,  we  added  to  our  regression  model  a  binary  variable  to  indicate  whether  or  not  that  data  was  missing. 
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analysis  does  not  suggest  that,  all  others  equal,  this  characteristic  affected  agencies'  enrollment 
decision. '^-'^ 

6.  Summary 

The  comparison  of  participants  and  invited  nonparticipants  confirms  some,  but  not  all,  of  our 
hypotheses  about  the  relationships  between  agencies'  characteristics  and  their  enrollment  decisions. 
Visiting  nurse  associations  and  other  fi-eestanding  agencies  were  attracted  to  the  demonstration, 
whereas  hospital-based  agencies  were  significantly  less  so.  On  average,  agencies  that  enrolled  in 
the  demonstration  were  older  and  larger  than  invited  nonparticipants,  and  provided  more  of  every 
type  of  Medicare-covered  service  with  in-house  staff.  The  most  striking  similarities  between 
participants  and  nonparticipants  have  to  do  with  their  financial  characteristics.  We  expected 
financial  characteristics  to  have  had  the  greatest  effect  on  agencies'  perceived  profitability  and 
enrollment.  In  fact,  participants  and  nonparticipants  had  roughly  equal  per-visit  costs.  Moreover, 
the  regression  analysis  showed  that  high-cost  agencies  were  no  more  likely  than  other  agencies  to 
join  the  demonstration.  The  reader  is  reminded,  however,  that  the  comparison  of  cost  characteristics 
was  not  based  on  a  full  sample  of  participants  and  nonparticipants.  Thus,  our  findings  should  be 
considered  with  caution. 


'^Because  we  were  missing  cost-Umit  ratios  for  59  percent  of  the  agencies  in  our  regression 
sample,  we  included  in  our  model  a  binary  variable  to  indicate  whether  or  not  each  agency  was 
missing  that  variable.  Use  of  the  binary  variable  had  two  desirable  effects:  (1)  it  prevented  agencies 
with  missing  cost-limit  ratios  fi-om  being  removed  fi-om  the  regression  equation  altogether,  and  (2) 
it  eliminated  any  bias  that  would  exist  if  below-cost  agencies  were  more  likely  than  others  to  have 
been  missing  their  cost-limit  ratios. 

'^To  test  the  sensitivity  of  our  logistic  regression  model,  we  also  estimated  a  linear  regression 
model  using  the  same  variables,  hi  both  models,  differences  in  provider  type,  metropolitan-area 
status,  and  whether  or  not  the  agency  was  fiill-service  were  statistically  significant.  No  other 
differences  were  significant  at  the  .10  level. 
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We  discuss  the  implications  of  these  findings  in  the  final  section  of  this  report.  In  the  next 
section,  we  compare  demonstration  participants  with  eligible  nonparticipants  throughout  the  country. 

B.   FINDINGS  FROM  THE  NATIONAL  COMPARISON 

To  assess  the  national  generalizability  of  the  findings  fi"om  the  demonstration  evaluation,  we 
repeated  the  foregoing  descriptive  analysis,  this  time  comparing  demonstration  participants  to  a 
national  sample  of  ehgible  nonparticipants.  We  found  that  many,  but  not  all,  of  the  similarities  and 
differences  that  we  observed  in  the  first,  five-state  comparison,  are  mirrored  in  the  national 
comparison.  A  discussion  of  these  findings  follows. 

1.    Structural  Characteristics 

In  the  nation,  as  in  the  five  demonstration  states,  demonstration  participants  underrepresented 
the  national  proportion  of  hospital-based  agencies  by  21  points  and  overrepresented  visiting  nurses 
associations  by  23  points  (see  Table  III.7).''*  However,  the  variation  in  proprietary  status  that  we 
observed  in  the  five-state  comparison,  (where  48  percent  of  demonstration  agencies  were  for-profit, 
versus  58  percent  of  invited  nonparticipants)  disappears  in  the  national  comparison  (47  percent  of 
eligible  nonparticipants  were  for-profit).  Likewise,  the  14-percentage-point  gap  observed  when  we 
compared  participants  and  invited  nonparticipants  with  more  than  10  years'  Medicare  participation 
narrowed  to  8  percentage  points,  and  lost  statistical  significance,  in  the  national  comparison.  Thus, 
in  terms  of  proprietary  status  and  Medicare  tenure,  demonstration  agencies  were  more  representative 
nationally  than  locally. 

''*The  finding  that  eligible  nonparticipants  were  21  percentage  points  more  likely  than 
participants  to  have  been  hospital-based  is  drawn  from  provider-type  data  in  the  PCS  file.  If  the  223 
Cost  Limit  File  had  been  used  to  determine  provider-type,  then  we  estimate  that  the  difference 
between  the  two  groups  of  agencies  would  have  been  between  16  and  18  percentage  points.  See 
Appendix  A  for  details. 
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TABLE  III.7 


STRUCTURAL  CHARACTERISTICS  OF  PARTICIPANTS  AND  ELIGIBLE 
NONPARTICIPANTS,  1994 
(Percentages,  except  where  noted) 


Eligible 

Variable  Participants  Nonparticipants  Difference  p-Value" 
Provider  Type'' 

Hospital-based  11.6  32.7  -21.1  .000 

Visiting  nurses  association  34.9  11.8  23.1  .000 

Other  freestanding  53.5  55.5  -2.0  .712 

Proprietary  Status 

For  profit  47.7  46.3  1.4  .790 

Length  of  Participation  in  Medicare 

Less  than  5  years  10.2  11.1  -0.9  .795 

5  to  10  years  19.3  26.4  -7.1  .134 

More  than  10  years  70.5  62.5  8.0  .126 

Staff  Composition 

Average  Number  ofHealth  Care  Staff  61.8  41.0  20.8  .013 
Percent  of  All  StafP 

Healthcare  88.9  88.0  0.9  .559 

Other  11.1  12.0  -0.9  .559 

Percent  ofHealth  Care  Staff 

Registered  nurses  44.1  45.3  -1.2  .534 

Licensed  practical  nurses  10.9  8.1  2.8  .020 
Therapists,  audiologists,  and  speech 

pathologists  8.5  6.8  1.7  .059 

Social  workers  2.9  2.4  0.5  .259 

Home  health  aides  32^9  36^9  ^4^0  .048 

Number  of  Agencies  88  3,871  —  — 


Source:     1 994  Provider  of  Services  File. 

"The  p- value  is  the  a  priori  probability  of  observing  a  difference  in  means  or  distributions  as  large  as  that  obtained  for 
the  sample  if  the  participating  and  nonparticipating  agencies  were  drawn  randomly  from  the  same  population. 

''Tabulations  for  this  variable  exclude  two  participating  agencies  with  missing  data. 

"Health  care  staff  include  registered  nurses,  licensed  practical  nurses,  occupational  therapists,  physical  therapists, 
audiologists,  speech  pathologists,  social  workers,  home  health  aides,  pharmacists,  and  dieticians.  Other  staff  include 
all  those  not  otherwise  specified. 
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In  the  nation,  as  in  the  five  demonstration  states,  participants  were  larger  than  nonparticipants, 
employing,  on  average,  50  percent  more  staff  members.  Overall,  however,  the  proportions  of  staff 
with  various  skills  was  similar  across  participants  and  eligible  nonparticipants  (as  it  was  in  the 
five-state  comparison).  For  example,  participants  and  eligible  nonparticipants  employed  mostly 
registered  nurses  and  home  health  aides,  followed  by  increasingly  smaller  percentages  of  licensed 
practical  nurses  (LPNs),  therapists,  and  social  workers.  Thus,  while  there  are  a  few  statistically 
significant  differences  between  the  percentages  of  particular  types  of  staff  employed  by  either  group 
of  agencies  (for  example,  participants  employed  three  percentage  points  more  LPNs  than  did  eligible 
nonparticipants,  a  difference  that  is  significant  at  the  .05  level),  more  remarkable  is  the  overall 
similarity  in  agencies'  staffing  structures. 

2.    Service  Provision 

The  key  differences  and  similarities  we  observed  between  the  service  characteristics  of 
participants  and  invited  nonparticipants  in  the  five-state  comparison  are  also  evident  at  the  national 
level.  For  example,  compared  to  eligible  nonparticipants,  demonstration  participants  were  more 
likely  to  provide  each  of  the  six  Medicare-covered  home  health  services  with  in-house  staff  (see 
Table  111.8).  They  were  12  percentage  points  more  likely  to  provide  all  six  services  with  in-house 
staff  or  through  contracts.  This  same  difference  was  also  seen  in  the  comparison  of  agencies  in  the 
demonstration  states.  In  the  nation  as  in  the  demonstration  states,  participants  provided  56  percent 
more  visits  than  did  eligible  nonparticipants  (see  Table  in.9).  The  key  similarity  observed  between 
participants  and  nonparticipants  in  the  five-state  comparison  was  also  mirrored  nationally. 
Demonstration  participants  and  eligible  nonparticipants  alike  provided  mostly  nursing  and  home 
health  aide  visits,  followed  by  much  smaller  proportions  of  therapy  and  medical  social  visits. 
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TABLE  III.8 


MEDICARE  HOME  HEALTH  SERVICES  OFFERED  BY  PARTICIPANTS 
AND  ELIGIBLE  NONPARTICIPANTS,  1994 
(Percentages,  except  where  noted) 


Eligible 

Services  Offered  Participants  Nonparticipants  Difference  p-Value^ 
Nursing: 

By  staff  100.0  99.9  0.1  .763 

Not  provided  0.0  0.0  0.0 

Physical  Therapy: 

By  staff  68.2  64.7  3.5  .501 

Not  provided  4.5  6.1  -1.6  .541 

Occupational  Therapy: 

By  staff  54.5  46.4  8.1  .130 

Not  provided  18.2  21.8  -3.6  .412 

Speech  Therapy: 

By  staff  54.5  43.8  10.7  .045 

Not  provided  15.9  14.6  1.3  .730 

Medical  Social  Services: 

By  staff  72.7  67.0  5.7  .255 

Not  provided  5.7  16.6  -10.9  .006 

Home  Health  Aide  Services: 

By  staff  98.9  95.0  3.9  .097 

Not  provided  1.1  1.9  -0.8  .618 

Provided  All  Six  Services'^  42^0  30J  n^9  .024 

Number  of  Agencies  88  3,871  —  — 


Source:  1 994  Provider  of  Services  File. 

^The  p-value  is  the  a  priori  probability  of  observing  a  difference  in  means  or  distributions  as  large 
as  that  obtained  for  the  sample  if  the  participating  and  nonparticipating  agencies  were  drawn 
randomly  from  the  same  population. 

Includes  agencies  that  provided  all  six  services  with  in-house  staff  or  through  contracts. 
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TABLE  III.9 


NUMBER  AND  DISTRIBUTION  OF  VISITS  PROVIDED  BY  PARTICIPANTS 
AND  ELIGIBLE  NONPARTICIPANTS,  FOR  FISCAL  YEARS  ENDING 
BETWEEN  MAY  1995  AND  DECEMBER  1995 


Eligible 

Variable  Participants    Nonparticipants    Difference  p-Value^ 


Average  Number  of  Medicare 
Visits" 


Total 

71,491 

45,850 

25,641 

.014 

Home  Health  Aide  Services 

34,016 

22,767 

11,249 

.051 

Nursing 

30,136 

18,398 

11,738 

.002 

Physical  Therapy 

5,448 

3,412 

2,036 

.019 

Occupational  Therapy 

850 

534 

316 

.028 

Medical  Social  Services 

694 

498 

196 

.104 

Speech  Therapy 

347 

243 

104 

.093 

Distribution  of  Visits 

Percent  Home  Health  Aide  Services 

42.3 

46.9 

-4.6 

.010 

Percent  Nursing 

46.2 

42.7 

3.5 

.019 

Percent  Physical  Therapy 

8.4 

7.7 

0.7 

.361 

Percent  Occupational  Therapy 

1.4 

1.2 

0.2 

.255 

Percent  Medical  Social  Services 

1.1 

1.0 

0.1 

.322 

Percent  Speech  Therapy 

0.6 

0.5 

0.1 

.320 

Number  of  Agencies  70  1,635 


Source:  223  Cost  Limit  File  (Cycles  15  and  16). 

NOTE:  The  statistics  in  this  table  are  based  on  fewer  agencies  than  in  other  tables  because  of 
missing  cost  report  data.  In  general,  data  are  missing  because  ( 1 )  an  agency  was  hospital- 
based  and  therefore  not  required  to  file  a  cost  report,  or  (2)  an  agency  did  not  have  a  settled 
cost  report  that  coincided  with  the  period  of  observation  for  this  analysis. 

^The  p-value  is  the  a  priori  probability  of  observing  a  difference  in  means  or  distributions  as  large  as 
that  obtained  for  the  sample  if  the  participating  and  nonparticipating  agencies  were  drawn  randomly 
from  the  same  population. 

''All  agencies  were  weighted  equally  in  the  calculation  of  the  averages.  That  is,  agencies  that  did  not 
offer  a  particular  service  were  considered  to  have  zero  visits  of  that  type;  but  the  agency  itself  was 
included  in  (the  denominator  of)  our  calculations  of  averages. 
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3.  Financial  Characteristics 

Judging  from  the  data  that  was  available  for  this  analysis,  participants  were  representative  of 
other  agencies  in  median  per- visit  costs  for  five  of  the  Medicare  home  health  services  (see  Table 
III.  10).  As  seen  in  the  first  comparison,  however,  their  median  per-visit  cost  for  medical  social 
services  seemed  to  be  above  the  national  average.  We  also  observe,  as  we  did  in  the  first 
comparison,  that  participating  agencies  seemed  to  be  underrepresentative  of  agencies  with  aggregate 
costs  above  their  aggregate  cost  limits.  Approximately  14  percent  of  eligible  nonparticipants 
exceeded  their  cost  limits  in  the  year  before  the  demonstration,  compared  with  8  percent  of  agencies 
that  chose  to  participate.  Finally,  as  in  the  first  comparison,  demonstration  agencies  were  as  likely 
as  nonparticipants  to  participate  in  Medicaid  (data  not  shown;  93  percent  of  participants  had 
Medicaid  contracts,  versus  90  percent  of  eligible  nonparticipants). 

4.  Environmental  Characteristics 

In  the  five  demonstration  states,  participating  and  nonparticipating  agencies  operated  in  similar 
external  environments.  Several  differences  emerge,  however,  when  demonstration  agencies  are 
compared  with  eligible  agencies  in  all  states.  Demonstration  agencies  underrepresented  the  national 
share  of  eligible  agencies  in  nonmetropolitan  areas  (see  Table  III.  11).  (By  contrast,  in  the  five 
demonstration  states,  there  was  a  higher  percentage  of  metropolitan  agencies  among  nonparticipants 
than  among  participants.)  Compared  to  eligible  nonparticipants,  participants  served  counties  with 
somewhat  lower  percentages  of  elderly  residents.  Participants  served  counties  in  which  annual  per- 
capita  incomes  were  about  $1,300  higher  than  in  counties  served  by  nonparticipants.  At  the  same 
time,  unemployment  rates  were  significantly  higher  in  counties  served  by  participants.  It  is  also 
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TABLE  III.  10 


COST  CHARACTERISTICS  FOR  PARTICIPANTS  AND  ELIGIBLE  NONPARTICIPANTS, 
FOR  FISCAL  YEARS  ENDING  BETWEEN  MAY  1995  AND  DECEMBER  1995 


Eligible 

Characteristic  Participants        Nonparticipants       Difference  p-Value^ 


Median  Cost  per  Medicare  Visit'' 


Home  Health  Aide  Services 

$37.60 

$35.71 

$1.89 

.169 

Nursing 

$81.66 

$78.25 

$3.41 

.167 

Physical  Therapy 

$90.69 

$88.14 

$2.55 

.443 

Occupational  Therapy 

$88.50 

$90.20 

-$1.70 

.689 

Medical  Social  Services 

$134.84 

$112.37 

$22.47 

.030 

Speech  Therapy 

$93.53 

$91.07 

$2.46 

.586 

Cost-to-Cost-Limit  Ratio: 

Average  of  Ratios 

.81 

.84 

-0.03 

.335 

Distribution  of  Ratios 

Under  75  Percent 

28.4 

30.4 

-2.0 

.726 

75  to  84  Percent 

28.3 

25.3 

3.0 

.578 

85  to  99  Percent 

35.8 

30.1 

5.7 

.319 

100  to  1 14  Percent 

7.5 

10.3 

-2.8 

.451 

1 1 5  Percent  or  more 

0.0 

3.9 

-3.9 

.100 

Minimum  Number  of  Agencies' 

57 

1,131 

Source:     223  Cost  Limit  File  (Cycles  1 5  and  1 6). 


NOTE:  The  statistics  in  this  table  are  based  on  fewer  agencies  than  in  other  tables  because  of  missing  cost  report 
data.  In  general,  data  are  missing  because  (1)  an  agency  was  hospital-based  and  therefore  not  required  to 
file  a  cost  report,  or  (2)  an  agency  did  not  have  a  settled  cost  report  that  coincided  with  the  period  of 
observation  for  this  analysis. 

^The  p-value  is  the  a  priori  probability  of  observing  a  difference  in  means,  medians,  or  distributions  as  large  as  that 
obtained  for  the  sample  if  the  participating  and  nonparticipating  agencies  were  drawn  randomly  from  the  same 
population. 

Agencies  are  excluded  from  calculating  the  median  cost  of  a  given  type  of  visit  if  they  did  not  render  that  type  of  visit. 

"Sample  sizes  vary  from  discipline  to  discipline  because  of  missing  data.  For  the  participants,  sample  sizes  range  from 
57  to  67;  for  eligible  nonparticipants,  sample  sizes  range  from  1,131  to  1,386. 
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TABLE  III.  11 


AREA  CHARACTERISTICS  FOR  PARTICIPANTS  AND  ELIGIBLE  NONPARTICIPANTS,  1994 

(Except  where  noted) 


Characteristic 


Eligible 

Participants         Nonparticipants         Difference  p-Value^ 


Percent  in  a  Metropolitan  Statistical 
Area  (MSA) 

County  Demographics 

Percent  of  County  Population 

Over  Age  65 
Percent  of  County  Population  That 

Is  Black 


84.1 


12.6 
12.3 


Econoinic  Indicators 

Annual  Per-Capita  Income 

(in  dollars)  22,393 

Unemployment  Rate  6.6 

Health  Care  Supply  and  Use 

Physicians  per  1,000  Population  2.4 

Average  Nursing  Home  Beds  per 

1,000  Elderly  (1991)  42.5 

Average  Hospital  Occupancy  Rates  57.4 

Average  Medicare 

Reimbursements  per  Beneficiary 

(1991)  (in  dollars)  3,387 


73.5 


13.4 
12.5 


21,049 
6.1 

2.3 

48.7 
59.6 

3,248 


10.6 


-0.8 
-0.2 


1,344 
0.5 

0.1 

-6.2 
-2.2 

139 


.025 


.052 
.921 


.015 
.032 

.600 

.017 
.202 

.043 


Number  of  Agencies 


88 


3,831' 


Source:     2000  Area  Resource  File;  223  Cost  Lrniit  File  (Cycles  15  and  16)  for  MSA  status. 

^The  p-value  is  the  a  priori  probability  of  observing  a  difference  in  means  or  distributions  as  large  as  that  obtained  for 
the  sample  if  the  participating  and  nonparticipating  agencies  were  drawn  randomly  from  the  same  population. 

This  table  excludes  40  agencies  in  Puerto  Rico;  the  Area  Resource  File  does  not  include  data  on  Puerto  Rico. 
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notable  that  demonstration  participants  served  counties  with  an  average  of  43  nursing  home  beds  per 
1,000  elderly  residents  in  preenrollment  periods,  while  eligible  nonparticipants  served  counties  with 
an  average  of  49  nursing  home  beds  per  1,000  elderly.  This  difference  is  statistically  significant, 
although  it  does  not  run  in  the  expected  direction.  Finally,  nonparticipants  served  counties  in  which 
the  average  Medicare  reimbursement  per  beneficiary  was  slightly  lower  than  the  average 
reimbursement  in  counties  served  by  demonstration  participants.  Such  differences  between 
participants  and  nonparticipants  are  probably  due  to  the  fact  that  the  demonstration  drew  participants 
from  only  five  states,  all  of  which  have  very  large  urban  areas.  Rural  states,  by  contrast,  have  a 
higher  proportion  of  elderly  residents,  lower  per-capita  income,  and  lower  average  Medicare 
reimbursements  per  beneficiary  than  urban  states  (Frenzen  1997). 
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IV.  DISCUSSION  AND  CONCLUSION 


The  portraits  of  participants  and  nonparticipants  that  emerge  from  the  comparison  of  agencies 
in  the  five  demonstration  states  bear  both  similarities  and  differences.  Many  participating  agencies 
were  visiting  nurse  associations,  and  most  had  long  Medicare  tenures;  they  were  high-volume 
agencies  with  relatively  large  staffs.  By  contrast,  nonparticipants  were  smaller,  on  average,  had  less 
Medicare  experience,  were  more  likely  to  be  based  in  hospitals,  and  were  somewhat  more  likely  not 
to  provide  some  Medicare  services.  Despite  such  differences,  participants  and  nonparticipants 
operated  in  similar  external  environments,  drawing  clients  from  like  populations.  Judging  from 
limited  data,  they  seemed  equally  likely  to  have  had  high  preenrollment  costs.  Similarly,  our 
regression  analysis  suggested  that  high-cost  agencies  were  no  more  likely  than  other  agencies  to 
have  joined  the  demonstration. 

Although  different  types  of  agencies  joined  the  demonstration  at  different  rates,  previous 
research  suggests  that,  once  they  were  operating  under  prospective  payment,  the  agencies  behaved 
similarly,  regardless  of  type.  In  studies  of  the  demonstration's  impact  on  quality  of  care,  access  to 
care,  patient  selection,  and  Medicare  service  use  and  reimbursement  (Chen  2000;  Trenholm  2000a, 
2000b;  Schore  2000;  and  Cheh  and  Black  2001),  subgroup  analyses  were  conducted  to  determine 
whether  different  types  of  agencies  behaved  differently  from  each  other  under  prospective  payment. 
The  studies  defined  agency  subgroups  by  profit  status,  service  volume,  provider  type,  and  whether 
an  agency  was  above  or  below  its  cost  limits  in  the  year  before  enrollment.  The  results  suggested 
that  impacts  for  these  subgroups  did  not  differ  markedly  from  those  of  the  overall  sample  in  each 
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of  the  substantive  areas. The  subgroup  analyses,  together  with  the  current  findings  that  few  agency 
characteristics  significantly  affected  enrollment  when  estimated  simultaneously,  suggest  that  there 
is  no  pressing  need  to  revisit  or  revise  earlier  interpretations  of  demonstration  impacts. 

Did  demonstration  participants  represent  other  home  health  agencies  in  the  country  well  enough 
to  guide  expectations  about  nationwide  implementation?  Both  participants  and  "eligible" 
nonparticipants  seemed  to  have  similar  median  per- visit  costs  for  five  out  of  six  Medicare  home 
health  services,  as  well  as  similarly  distributed  cost-to-cost-limit  ratios.  The  typical  demonstration 
agency,  however,  was  larger  than  other  agencies  in  terms  of  staff  and  service  volume.  The  group 
of  participants  also  underrepresented  the  national  share  of  hospital-based  and  nonmetropolitan 
agencies. 

To  assess  the  significance  of  such  differences,  it  is  usefiil  to  consider  recent  changes  in  the 
home  health  industry.  In  October  1997,  HCFA  implemented  an  Interim  Payment  System  (IPS)  to 
transition  home  health  agencies  fi-om  cost  reimbursement  to  prospective  rate  setting.  The  IPS 
encouraged  agencies  to  control  beneficiaries'  service  use  by  lowering  per- visit  payment  limits  and 
capping  the  Medicare  revenues  an  agency  could  collect  per  beneficiary.  Within  15  months  of 
implementation  of  the  IPS,  14  percent  of  the  country's  home  health  agencies  closed  or  withdrew 
fi-om  Medicare.  The  General  Accounting  Office  concluded  that  many  of  the  closures  were  in  direct 
response  to  the  IPS  incentives  (General  Accounfing  Office  1999). 

The  pattern  of  IPS  closures  has  implications  for  the  present  analysis:  today's  population  of 
home  health  agencies  is  more  homogenous  than  it  was  in  the  year  before  the  prospective  payment 
demonstration.  In  other  words,  many  of  the  significant  predemonstration  differences  observed  in 

'^The  studies  did  reveal  some  differences— for  example,  in  the  amount  by  which  prospectively 
paid  hospital-based  agencies  and  freestanding  agencies  reduced  Medicare  services.  But  such 
differences  (as  noted  in  Chen's  2000  quality  analysis)  were  too  small  to  affect  patient  outcomes. 
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this  analysis  probably  have  diminished.  Agencies  that  closed  between  October  1 997  and  January 
1999  were  about  half  the  size  of  agencies  that  continued  to  provide  Medicare  home  health  services; 
they  also  tended  to  be  newer  and  treated  a  smaller  number  of  beneficiaries  (General  Accounting 
Office  1999).  Ailer  the  closings  or  withdrawals  fi-om  Medicare,  larger  proportions  of  the  remaining 
population  of  Medicare  home  health  agencies  were  large,  high- volume  agencies  with  long  Medicare 
tenures.  In  other  words,  the  remaining  agencies  seem  to  share  important  characteristics  with  the 
demonstration  participants,  which  also  tended  to  be  large,  high-volume,  and  well-established  in 
Medicare.  As  a  result,  it  seems  reasonable  to  expect  that  findings  from  the  evaluation  of  the  Home 
Health  Per-Episode  Prospective  Payment  Demonstration  are  fairly  generalizable  to  the  nation  as  a 
whole. 

In  summary,  this  analysis  is  reassuring  but  not  exhaustive  or  entirely  conclusive.  Our 
comparison  has  revealed  a  number  of  differences  between  the  structural,  service,  cost,  and 
environmental  characteristics  of  demonstration  participants  and  invited  and  eligible  nonparticipants. 
The  observed  differences,  however,  were  (1)  too  small  to  create  concern  that  the  results  of  the 
previous  impact  analyses  are  not  generalizable  to  the  population  of  agencies,  or  (2)  less  evident  since 
the  introduction  of  the  IPS.  It  must  be  noted,  however,  that  similarities  on  observable  characteristics 
cannot  entirely  abate  concern  over  differences  in  unobservable  characteristics.  Unobservable 
characteristics— for  example,  employee  resistance  to  or  acceptance  of  change— may  have  influenced 
agencies'  enrollment  decisions.  This  analysis  is  fiirther  limited  by  a  lack  of  cost  report  data  for  many 
agencies  and  a  lack  of  base-year,  visits-per-episode  data  for  all  agencies.  In  light  of  these 
shortcomings,  caution  must  be  exercised  when  generalizing  from  the  sample  of  home  health  agencies 
that  elected  to  participate  in  the  prospective  payment  demonstration  to  the  population  of  agencies 
now  operating  in  the  throes  of  a  new  system. 
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APPENDIX  A 


DISTINGUISHING  BETWEEN  FREESTANDING  AND 
HOSPITAL-BASED  AGENCIES 


In  this  analysis,  we  used  data  from  the  Provider  of  Services  (POS)  file  to  calculate  the 
proportion  of  agencies  that  were  freestanding  versus  hospital-based.  The  223  Cost  Limit  Files, 
which  include  data  obtained  from  Free  Standing  Medicare  HHA  Cost  Reports,  are  an  alternative,  and 
potentially  more  reliable,  source  of  the  same  information.'^  Agencies  that  file  Free  Standing 
Medicare  HHA  Cost  Reports  are  paid  by  HCFA  as  freestanding  agencies  even  if  they  are  affiliated 
with  hospitals.  Agencies  that  are  included  in  a  hospital's  cost  report,  but  not  in  the  223  Cost  Limit 
File,  have  demonstrated  to  HCFA's  satisfaction  that  they  are  not  freestanding  agencies.  By  contrast, 
agencies  may  be  miscoded  as  hospital-based  in  the  POS  file  (though  they  actually  are  hospital- 
affiliated);  there  is  no  mechanism  to  double-check  the  coding  since  there  are  no  financial 
consequences  of  such  mistakes. 

In  comparing  provider-type  data  in  the  POS  and  Cost  Limit  files,  we  found  a  total  of  244 
discrepancies  in  which  agencies  coded  as  hospital-based  in  the  POS  file  also  appeared  in  the  Cost 
Limit  File  (and  are  presumably  freestanding).  The  discrepancies  suggest  that  the  16-point  gap  we 
observed  in  the  percentage  of  hospital-based  participants  and  invited  nonparticipants  may  be  too 
large  (see  Table  III.l).  Similarly,  the  21 -point  gap  observed  in  the  percentage  of  hospital-based 
participants  and  eligible  nonparticipants  may  also  be  too  large  (see  Table  III.7). 

Of  the  244  agencies  whose  provider  type  was  in  doubt,  5  were  demonstration  participants  (3.4 
percent),  53  were  invited  nonparticipants  (5.1  percent),  and  241  were  eligible  nonparticipants  (6.2 
percent).'"'  If  we  consider  these  agencies  to  have  been  freestanding  (as  implied  by  the  Cost  Limit 
File),  rather  than  hospital-based  (as  implied  by  the  POS  file),  then  8  percent  of  demonstration 

'^Throughout  the  demonstration  evaluation,  we  considered  agencies  to  be  freestanding  if  their 
cost  reports  were  included  in  the  223  Cost  Limit  Files. 

'^The  241  eligible  nonparticipants  include  53  nonparticipants  from  the  five  demonstration  states 
plus  188  from  the  nondemonstration  states. 
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participants  would  have  been  hospital-based,  versus  23  percent  of  invited  nonparticipants  and  26 
percent  of  eligible  nonparticipants  (see  Table  A.l).  However,  one  problem  in  using  the  Cost  Limit 
File  as  a  source  of  provider-type  data  is  that  the  file  does  not  contain  data  for  a  large  percentage  of 
the  agencies  in  our  sample.'^  If,  however,  we  assume  that  the  agencies  in  our  sample  that  did  not 
appear  in  the  Cost  Limit  File  were  to  "switch"  jfrom  hospital-based  to  freestanding  at  the  same  rates 
as  agencies  that  did  appear  in  the  Cost  Limit  File,  then  7  percent  of  the  demonstration  participants 
would  have  been  hospital-based,  versus  20  percent  of  invited  nonparticipants  and  23  percent  of 
eligible  nonparticipants. 

Thus,  in  using  the  POS  file  as  our  source  of  provider-type  data,  we  may  have  slightly 
overestimated  the  differences  between  the  percentages  of  hospital-based  participants  and 
nonparticipants.  However,  regardless  of  data  source  or  assumptions  about  agencies  with  missing 
data,  hospital-based  agencies  were  substantially  underrepresented  in  the  prospective  payment 
demonstration. 


'^Another  problem  with  using  the  Cost  Limit  File  as  a  source  of  provider-type  data  is  that  it 
would  not  allow  us  to  distinguish  between  visiting  nurse  associations  and  other  freestanding  home 
health  agencies. 
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